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Abstract 

The P300 speller is being considered as an independent brain-computer interface. That means it 
measures the user's intent, and does not require the user to move any muscles. In particular it should 
not require eye fixation of the desired character. However, it has been shown that posterior electrodes 
provide significant discriminative information, which is likely related to visual processing. These 
findings imply the need for studies controlling the effect of eye movements. In experiments with a 3 x 3 
character matrix, attention and eye fixation was directed to different characters. In the event-related 
potentials, a P300 occurred for the attended character, and N200 was seen for the trials showing the 
focussed character. It occurred at posterior sites, reaching its peak at 200ms after stimulus onset. The 
results suggest that gaze direction plays an important role in P300 speller paradigm. By controlling 
gaze direction it is possible to separate voluntary and involuntary EEG responses to the highlighting 
of characters. 



Introduction 



Brain-computer interfaces (BCIs) aim to provide 
new channels for man-machine communcation and 
control using brain signals. Numerous studies 
in the past showed that electroencephalography 
(EEG) is suitable for this purpose [3 [1 [3 H [5J E] . 
EEG-based BCI systems are non-invasive and 
comparatively easy to set up. They are especially 
suited for real-time applications due to their high 
temporal resolution. The P300 speller is one type 
of BCI first introduced by Donchin and Farwell 
[2]. Let us review the basic idea behind it. The 
subject sits in front of a screen presenting a ma- 
trix of characters. Rows and columns of charac- 
ters are highlighted in random order, while the 
subject focuses his attention to one desired (tar- 
get) character. This is usually done by perform- 
ing a mental count of the number of times the tar- 
get character is highlighted. Whenever the target 
character is highlighted a P300 is elicited. P300 
(P300b) is a component of the event-related po- 



tential (ERP) typically appearing as a positivity 
at electrodes covering the parietal lobe 300ms to 
400ms after stimulus onset [71 [HI IH]- It is an en- 
dogenous (voluntary) component, mainly reflecting 
mechanisms of attention allocation and immediate 
memory (8l [9] . This allows for inferring the target 
character from the EEG data by various statisti- 
cal methods [TUIIII]. The P300 speller needs little 
training and has been proven suitable for most per- 
sons [12] ■ It has been sucessfuUy implemented as a 
support for persons with physical disabilities, e.g. 
locked-in amyotrophic lateral sclerosis (ALS) pa- 
tients [T^ . 

According to [T3], a BCI is called independent if 
it does not make use of the brain's normal out- 
put pathways of peripheral nerves and muscles. 
It measures the users intention without requiring 
any movements, e.g. eye movements. P300 re- 
flects cognitive processes related to the perception 
of the target character. Since the target charac- 
ter can be attended covertly without fixating upon 
it [TS] the P300 speller is in general considered as 
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an independent BCI. On the other hand, it turned 
out that electrodes located over posterior lobe pro- 
vide discriminative information, which is not due 
to P300 [M HZ]. Whereas P300 is usually mea- 
sured at electrode Pz [3 |2] , adding posterior elec- 
trodes turned out to improve the classification per- 
formance of the P300 speller [HI [Hill]. Wave- 
form analysis shows a negative deflection preced- 
ing P300, approximately 200ms after stimulus on- 
set [m [TU [20] , which in the sequel is referred to 
as N200. This component is well known to be 
elicited in visual oddball experiments. Several sub- 
components were found which reflect both volun- 
tary and involuntary processing of visual stimuli 
^IT[ [221 [5] • Its role within the speller paradigm is 
not clear yet. It has been hypothesized that N200 
is related to visual processing of the fixated charac- 
ter [TBI [IZl [IB] • Transient visual evoked potentials 
(VEPs) due to highlighting of characters may con- 
tain components with peak latencies up to approx- 
imately 200ms [23]. If indeed N200 is due to invol- 
untary visual processing, we expect it to be strongly 
correlated with the fixated character. On the other 
hand, covert attention has been shown to modu- 
late ERP components at posterior sites as early as 
160ms t24j. If N200 mainly reflects voluntary pro- 
cessing, it should be correlated with the attended 
character. In this case the standard P300 speller 
can be regarded as independent. However, it seems 
that P300 speller studies do not control the effect 
of eye movements. Therefore we performed exeri- 
ments where the attended character differs from the 
flxated one. Subjects had to fixate one character 
while attending another one covertly. 

Donchin and Farwell originally introduced the 
P300 speller using a 6 x 6 matrix of characters, 
with rows and columns hashing successively at high 
presentation rate [2] . For the purpose of the study 
there are few reasons to alter the standard settings. 
First of all, covert attention to single characters 
may be difficult when using a large character ma- 
trix. We therefore used a 3 x 3 matrix, allowing for 
larger character size. Since P300 amplitude varies 
indirectly with the a priori probability of the tar- 
get stimulus [IS], single characters instead of rows 
and columns are highlighted. Characters were dark 
grey on light grey background and were set to black 
during the highlighting. It has been reported that 
this setup may be more convenient than the origi- 
nal white-on-black setting [261 . Another problem 
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Figure 1: Schematic representation of the stimulus 
paradigm. Single characters were highlighted for 
600ms followed by a randomised break lasting up 
to 5Qms. 

comes with usage of small interstimulus intervals 
in the standard P300 speller. It was shown to in- 
troduce overlap and refractory effects of the ERPs 
[21] ■ We avoid such problems by using longer in- 
terstimulus intervals than the standard one. 

Methods 
Participants 

Ten healthy volunteers (2 male, 8 female) with nor- 
mal vision participated in the present study. All 
subjects except one had no previous experience 
with BCI-related experiments. Subjects gave writ- 
ten informed consent after the experiment was ex- 
plained to them. 

Experimental Setup 

The subjects sat in front of a 19 inch screen in 
a distance of about 50cm. They were instructed 
to relax and avoid blinking during the recordings 
as far as possible. Each single-trial lasted 600ms 
and one single character was highlighted during 
this time. The sequence of characters was ran- 
domised, with each character being highlighted the 
same number of times, and a total number of trials 
lying between 450 and 477. Between two consecu- 
tive trials there was a randomised break lasting up 
to 50ms, where no character was highlighted (see 
Figure [T]) . Hence the interstimulus interval varied 
between 600ms and 650ms. The experiment con- 
sisted of two parts, with a short break in between. 
(I) Combined attention and fixation. In the 
first part of the experiment subjects had to fixate 
the target character "E" in the center of the screen. 
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Figure 2: ERP waveforms for combined attention and fixation. Grand average ERPs for attended/fixated 
character (red), and the eight remaining ones (grey). Time points where t-tests revealed significant 
differences between red and each grey curve were shaded red (a = 0.1%). 



They were instructed to mentally count the num- 
ber of times it is highlighted. Afterwards they were 
asked for the count and given feedback on the cor- 
rectness. 

(II) Separated attention and fixation. In the 

second part subjects still had to fixate the charac- 
ter "E" , but count the new target character "B" in- 
stead. As in the first session they were instructed to 
perform a mental count of the number of times the 
target character is highlighted. They were asked 
for the count and given feedback on the correct- 
ness. The total number of trials was different from 
the one in the first session. 

Afterwards subjects used the P300 speller in online 
mode using the data from the first experiment as 
training for linear discriminant analysis 1111. This 
part will not be discussed here. 

Matrix style 

We used a 3 x 3 matrix of characters. To access 
all characters of the alphabet in the online session 
after the experiments, we used additional symbols 
for switching the character set located at the lower 
right and left edge (see Figure [1]). Characters were 



dark grey (rgb 128, 128, 128) on light grey back- 
ground (rgb 200, 208, 212) and were set to black 
during the highlighting. 



Data collection and preprocessing 

The data were recorded using a Biosemi ActiveTwo 
system with 32 electrodes placed at positions of 
the modified 10-20 system and sampling rate of 
2048Hz. They were referenced by subtracting the 
mean over all electrodes for each time point. To 
normalize data in time we subtracted the mean 
of the first 50ms from each single trial. We ap- 
plied a 5th order Chebyshev type II bandpass filter 
with edge frequencies 0.1 Hz and 48Hz, and stop- 
band ripple 50dB down from passband. To avoid 
phase shifts the filter was applied both forward and 
backward in time. Trials containing blinks were re- 
jected after visual inspection of channel Fpl. The 
relative number of trials rejected was smaller than 
12% for all subjects, resulting in a net number of 
399 to 473 trials for single subjects. 
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Figure 3: ERP waveforms for separated attention and fixation. Grand average ERPs for attended (red), 
fixated (blue) , and the seven remaining characters (grey) . Time points where t-tests revealed significant 
differences between red/blue curve and each remaining one were shaded red/blue {a = O.f %). 



Results 

Combined attention and fixation 

In the first part of the experiment subjects had to 
fixate and count the target character "E" while ne- 
glecting all others. Figure [2] shows the grand aver- 
age ERPs for all trials presenting the target char- 
acter (red curve), and trials presenting the eight 
non-target ones (grey curves). To examine signifi- 
cant differences among them, we performed t-tests 
for equality of target and each non-target ERP. 
Time points where all eight null hypotheses were 
rejected at 0.1% level were shaded red. The ERP 
of the target character contained a P300 compo- 
nent, reaching its peak 400ms after stimlus onset 
with an amplitude of approximately 4^V at elec- 
trode Pz. P300 waveform had a rather broad shape, 
starting from 300ms and lasting until 600ms. Fig- 
ure m shows the topographic map of the ERP for 
the target character at 400ms. It shows the typi- 
cal spatial distribution with a positivity at parieto- 
central electrodes and declining to the periphery 
[71 [5]. Besides this, the data also contained discrim- 
inantivc information at posterior electrodes before 



300ms (see Figure [5]). In agreement to the find- 
ings in [iHl [191 [2S] there was a N200 appearing as a 
negative deflection at posterior sites at both hemi- 
spheres symmetrically. N200 reached a first peak 
200ms after stimulus onset with an amplitude of 
approximately — 6/iV at P7. The corresponding to- 
pographic map is shown in Figure [H The most 
complete picture of N200 within the P300 speller 
has been given in |20j during a comparison with 
a new type of speller paradigm. Although using a 
6x6 character matrix, they find similar topography 
and latency. 

Since the fixated character coincided with the 
attended one, we can not understand the nature 
of N200 from the first part of the experiment. It 
could be both related to involuntary processing due 
to eye fixation and to voluntary processing because 
subjects were attending the target character while 
performing the mental count. We therefore sepa- 
rated both in the second experiment. 

Separated attention and fixation 

In the second part of the experiment subjects still 
had to fixate the character "E" , but now count "B" 
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instead. This allowed for separating involuntary 
and voluntary processing by analyzing the ERPs 
to the attended target character and the fixated 
one, respectively. Figure [3] shows the grand average 
over trials presenting the fixated character (blue 
curve), the attended one (red curve), and the re- 
maining seven non-target ones (grey curves) . Once 
again, we performed t-tests for equality of ERPs to 
fixated and each non-fixated character as well as 
attended and each non-attended character. Time 
points where all eight null hypotheses were rejected 
at the 0.1% level were shaded blue and red respec- 
tively. It is well known that visuospatial attention 
can be directed to non-fixated locations in the vi- 
sual field [IS]. Hence we expected P300 appearing 
for the attended target character "B" . Indeed there 
was a late positivity with an amplitude of approx- 
imately 3/LtV at electrode Pz, as can be seen from 
the red curve in Figure |31 Figure [5] shows the corre- 
sponding topographic map at 450ms. So although 
the target character was not fixated, it elicited a 
P300 due to covert attention when subjects were 
performing the mental count. 

If N200 also represents voluntary processing sim- 
ilar to P300, it should for the attended character 
and not the fixated one. Our results indicate, that 
this is not the case. In contrast to the first ex- 
periment, N200 occurred for the fixated character 
and not the attended one (blue curve in Figure ^ . 
Note the remarkable similarity with the ERP to 
the target character in the first experiment within 
the first 250ms (red curve in Figure [5]). Indeed, 
except for electrodes C3 and AF4, t-tests revealed 
no significant differences between both within the 
first 280ms (a = 0.1%). There was no significant 
difference before 210ms for all electrodes. 

Discussion 

There have been speculations on the role of gaze 
direction in P300 speller BCI [THl HZl [H [H] . How- 
ever, to our best knowledge, so far no study con- 
trols the effect of eye movements in P300 speller 
paradigm. Hence we performed experiments where 
the attended character was either identical with the 
fixated one or where it differed from the last. We 
investigated the corresponding grand average ERPs 
and found two major components. As expected 
there was a P300 occurring for the attended target 




Figure 4: ERP topographies of N200 and P300 for 
combined attention and fixation. The grand aver- 
age ERP to the target character contained two ma- 
jor components, one posterior negativity at 200ms 
(left), and a late positivity at parietal sites, reach- 
ing a peak at 400ms (right). 




Figure 5: ERP topographies of N200 and P300 for 
separated attention and fixation. As in the first 
part of the experiment, the grand average ERP to 
the attended target character contained a late pos- 
itivity at parietal sites, reaching a peak at 450ms 
(right). In contrast, N200 occurred for the fixated 
character around 200ms after stimulus onset (left). 

character [2l [2] . It was elicited also in the second 
part of the experiment, where the target charac- 
ter was not fixated at the same time. In contrast, 
N200 occurred for the fixated character and not the 
attended one in both parts. This strongly suggest 
that N200 reflects involuntary processing of the fix- 
ated character. Moreover the ERP to the fixated 
character was virtually identical in both parts of 
the experiments up to 280ms after stimulus onset. 
These findings have consequences for the construc- 
tion of independent P300 spellers [H]. In general, 
if the user fixates the target character during the 
training phase, automatic feature extraction meth- 
ods will not lead to an independent BCI. 

By controlling gaze direction it is possible to sep- 
arate voluntary and involuntary EEC responses to 
the highlighting of characters. This finding leads 
to new interesting questions related to the P300 
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speller. For instanee, how does the use of covert 
attention only affects the performance of the P300 
speller? Is it still possible for most persons to use 
it at reasonable speed? These arc questions which 
should be adressed in further studies. 
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